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1 . Introduction 


The Chandrasekhar equations [12] are an alternative form to the Riccati 
equations from which the optimal feedback gain operator may be calculated 
directly. If the system has a small number of inputs and outputs, the 
Chandrasekhar algorithm offers significant reduction in the computational 
complexity for determining the optimal feedback gain. As observed in [18], 
this is much more evident in the infinite dimensional case if the optimal 
feedback gain operator is calculated numerically using some approximation 
method. In this case, the number of states grows linearly to the order of 

approximation . 

The purpose of this paper is to derive Chandrasekhar equations for 
systems defined by evolution equations on Hilbert spaces in which the input 
and output operators are assumed to be bounded. The form of the Chandrasekhar 
equations derived immediately implies that the solution of the associated 
Riccati equation is strongly differentiable in time, and it allows us to 
define a "strong" solution of the Riccati equation. Another important 

consequence of this is that the optimal control for the linear quadratic 
regulator (LQR) problem is continuously differentiable if the initial datum is 
sufficiently smooth. 

The Chandrasekhar equations for infinite dimensional systems have been 
discussed in [4] and [6] using a Lions-type framework [15]. However, the 
equations derived in [4] and [6] are satisfied in the distributional sense. 
In [19], Sorine derived a set of Chandrasekhar equations satisfied in a strong 
sense for parabolic systems. Sorine"s derivation relied on the analyticity of 
the semigroup and thus does not apply to general systems. Our approach 
differs from those above in that it uses an approximation technique. A 
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sequence of approximating optimal control problems is chosen for which the 
Chandrasekhar equations may be derived as in the finite dimensional case (see 
15], [12], and [14]). Convergence is then established and the appropriate 
equations are shown to be satisfied. In this paper, our considerations are 
restricted to the LQR problem, but the results are also applicable to the 
Kalman filtering problem [7] . 

The contents of the paper are as follows. Section 2 briefly recalls the 
linear quadratic problem and characterizes the optimal control (see [2], [8], 
and [15] for a survey of the literature). In Section 3 a characterization of 
the Riccati operator is derived and used to obtain the Chandrasekhar 
equations. Regularity results for the Riccati operator and optimal control 
are discussed in Section 4. As a specific example we discuss in Section 5 the 
linear quadratic optimal control problem for hereditary differential systems 
in which the input and output spaces are finite dimensional. Because of the 
smoothing property of the solution semigroup, results stronger than those of 
the general problem are obtained. 

The notation used in this paper is standard. The symbol <*,*> stands 
for the inner product in a Hilbert space where the underlying space will be 
understood from the context. Also, II* II denotes the norm for elements of a 
Banach space and for operators between Banach spaces, while |»| denotes the 
Euclidean norm. The adjoint of a densely defined operator A from one 
Hilbert space to another is denoted by A • 
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2. Riccati Equations 

Let Z, U, and Y be Hilbert spaces. We consider the evolution equation 

on Z 


( 2 . 1 ) 


z(t) = Az(t) + 8u(t), t >. 0 


z(0) = z € Z 


where u(») is a U-valued, square integrable (control) function and A is 
the infinitesimal generator of a strongly continuous semigroup S(t) on Z. 
The Y-valued (observation) function y is given by 


(2.2) y(t) = Cz(t) , t 2 0* 

We assume that 8£i(U,Z) and C € L( Z,Y). 

For any T > 0, if u is differentiable almost everywhere on 

[0,T], ueL^O.T;!!) and z€V(A), then the initial value problem (2.1) has a 

unique '"strong"’ solution [17, Corollary 2.10] in the sense that z is 
differentiable almost everywhere (a.e.) on [0,T] with z£Lj(0,T;Z) and 
(2.1) holds a.e. on [0,T]. It follows from Corollary 2.2 in [17] that (2.1) 

has at most one solution and if it has a solution, this solution is given by 

t 

(2.3) z ( t ) = S(t)z + / S(t - s)8u(s)ds 

0 

which we shall call the mild solution of (2.1). Moreover, the mild solution 
satisfies the 'weak' differential equation: 


T 
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^ <z(t),x> = <z(t),A x> + <8u(t),x> for all xeV(A )• 

Consider the linear quadratic optimal control problem on a finite time 
interval: for given initial data z€Z, choose the control u € L 2 (0,T; I?) 

that minimizes the cost functional 

T 

(2.4) J(u, [0,T]) = / (Hy(t)H 2 + llu(t)H 2 )dt + <Gz(T),z(T)>_ 

0 L 

where G is a nonnegative (definite), self-adjoint operator on Z and z is 
the mild solution to (2*1) • The next theorem, which characterizes the optimal 
control, follows from [2], [8] and [20]. 

Theorem 2.1: The optimal control u® of (2.4) is given by 

(2.5) u°(t) = -8* n(t)z°(t), t > 0 

where n(t), t _< T, is strongly continuous on Z. Moreover , H(t) is the 

unique solution within the class of nonnegative self-adjoint operators for 
which <II(t)z,z> is absolutely continuous for z 60(A), and satisfies the 

^weak differential^ Riccati equation 


(2.6) fL- <n(t)z,z> + 2<Az,H(t)z> - <8* n(t)z,8* n(t)z> + <Cz,Cz> = 0 


n(T) = g 


for all z eV(A) 
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If U(*»*) denotes the perturbed evolution operator of the semigroup 
S(t) by -88 II, then for z€Z 


(2.7) U(s,t)z = S(s - t)z - / S(s - o)B8 n(a)U(o,t)zda, 


II(t) satisfies 


(2.8) n(t)z = S*(T - t)GU(T,t)z + / S*(o - t)C* CU(a,t)zda, 

t 


z (t) = li(t,0)z. 


3* Chandrasekhar Equations 

From here on, we assume that Gz€V(A ) for all z€Z. By the closed 
graph theorem AG is then a bounded operator on Z. Let us define a 
bounded self-adjoint operator Q on Z by 


(3.1) 


<Qx,y> = <A Gx,y> + <x,A Gy> - <B Gx,B Gy> 


+ <Cx,Cy> for all x,y€ Z. 


The main result of this paper is given in the following theorem. 


Theorem 3.1: If n(t), t < T is the solution to the Riccati equation 


(2.6), then for z € Z 
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(3.2) 


* * 

n(t)z = Gz + / U (T,s)QU(T,s)zds. 
t 


Proof : If A is a bounded linear operator on Z, then 


S(t) 


At 

e 


00 


I 

n=0 


(At) n 

n! 


and t — *■ S(t) is differentiable in norm. Hence the same arguments as given 
in [12] for the finite dimensional system allow us to show that the theorem 
holds for such a case. Consider the Yosida approximation of A given by 


A x = XA(XI - A) 1 for X€lR + np(A). 


Then A^ is a bounded linear operator on Z and from Theorem 5.5 in [17] 

A x fc 

e z — ► S(t)z as A “ (strongly), z€Z 


uniformly on bounded t-intervals. Note that 

1* «* J* —1 

A = xA (Xi - A ) 1 . 

Indeed, for x€P(A) and y€Z 

<A X x,y> = <X(XI - A) -1 Ax,y> = <x,XA*(XI - A*) -1 y >. 

But since V(A) is dense in Z, this shows that A x = XA (XI - A) -i . Thus 
Theorem 5.5 in [17] again implies that 
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A* 

A t * 

e z — ► S (t)z, z € Z 


uniformly on bounded t-intervals. 

Consider the approximate problem (A X ,B,C) for which the theorem 
holds. If n x (t) and (•,•) denote the solution of the Riccati equation 
and the perturbated evolution operator corresponding to the perturbation of 

A,t * 

e by -88 II^(t), respectively, then 


where 


II^(t)z = Gz + / U^(T,s)Q^ U^(T,s)zds for z€Z 


Q x = A x G + GA^ - G88 G + C C. 


It follows from Theorem 6.1 in Gibson [11] that II x (t) converges strongly to 
II(t) for t < T, and the convergence is uniform on bounded t-intervals. 
Moreover, statement (6.14) in [11] implies that 


U x (t,s)z — *■ U(t,s)z, z € Z, 0 ^ s ^ t 


where the convergence is uniform in t and s. Hence, for all x€Z 


<n(t)x,x> = lim <IL(t)x,x> = <Gx,x> + lira / <Q X U x (T,s)x, U x (T,s)x>ds 
X+OO X+ 00 t 


(3.3) 


= <Gx,x> + lim / {2<A G(J. (T,s)x,J. U.(T,s)x> 


X+» t 


+ <(C* C - G88* G) U, (T,s)x, U. (T,s)x> }ds 
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where J x = X(XI - A) -1 , Xep(A). Note that 

J X U X (T » s)x = (J X - I >U(T,s)x + J x (U x (T,s) - U( T,s))x + U(T,s)x 

converges strongly to U(T,s)x for s < T since J x converges strongly to 
the identity operator I on Z (see, [17]). Since the integrand appearing 
in equation (3.3) is uniformly bounded in X and s, the dominated 

convergence theorem allows us to obtain that for x € Z 

T * 

<n(t)x,x> = <Gx,x> + / {2<A GU(T,s)x,U(T,s)x> 

t 

+ <(C*C- GBB* G)U(T,s)x,U(T,s)x>}ds 
T * 

= <(G + / U (T,s)QU(T,s)ds)x,x> 
t 

which completes the proof since the operators appearing in both sides of this 
equation are self-adjoint. 

(Q.E.D.) 

Remark 3.2 ; Important in applications is the case G = 0. If this 
occurs, then Q = C* C and 

T 

II(t)z = / L (s)L(s)zds, z £ Z 
t 

where L(s) hCU(T,s). Define the gain operator by K(t) = B* II(t). Then 


(see, Gibson [10]) 
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T 

U(T,t)T = S(T - t)z - / U(T,s)BK(s)S(s - t)zds, z€Z 

t 

and the operators K(t) and L(t) jointly satisfy 

T * 

K(t)z = / 8L (s)L(s)zds 
t 

T 

L(t)z = CS(T - t)z - / L(s)BK(s)S(s - t)zds, 

t 

for all z€Z, which are the infinite dimensional Chandrasekhar equations in 
integral form. Since K(t)z and L(t)x are differentiable for z£Z and 
x 6 0(A), K(t) and L(t) also satisfy 

K(t)z = -B* L*(t)L(t)z, z€Z, 
at 

K(T) = 0, 

L(t)x = -L(t)[A - B K( t ) ] x , x eV(A), 

L(t) = C. 

Note that these Chandrasekhar differential equations correspond to those 
derived for finite dimensional systems [12]. 


4. Strong Differential Riccati Equation 

An important consequence of (3.2) is the following theorem. 

Theorem 4.1: _If_ GZCP(A*) and H(t), t T, is the solution to the 

Riccati equation (2.6), then for z€Z JI(t)z is continuously differentiable 
on [0,T] and 

n(t)z = L*(t)L(t)z. 

The following two lemmas are essential to the derivation of the 'strong 
differential' Riccati equation. 

Lemma 4.2: Suppose that B(t) is an operator on Z such that for 

z£Z, B(t)z is continuously differentiable on [0,T]. Then A + B(t) 
generates a perturbed evolution operator V(t,s), of the semigroup S(t) _on 
Z and for z €V(A) V(t ,s)z € P(A) , 0 < s _< t T, V(t ,x)z is strongly 
differentiable in t , and 


(4.1) V(t,s)z = (A + 8(t))V(t,s)z 

9 

is satisfied for 0 s t <_ T. Moreover, the derivative V(t,s)z for 

z € P( A) is jointly continuous in t and s . 

Proof : Consider a class 51 of evolution operators on Z as follows: 

51 consists of bounded linear operators V(t,s), 0<s<t<T on Z such 
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(li) (t,s) — ► V(t,s) is strongly continuous for 0 < s < t < T 
(iii) for z€P(A), V(t,s)z€P(A) is strongly differentiable in t and 
the derivative V(t,s)z is strongly continuous in t and s for 
° < s < t T. 

Note that V^^(t,s)z = S(t - s)z, z€Z belongs to 51. Define a sequence of 

(k) 

evolution operators V (t,s) by 

(4.2) V (k+1) (t,s)z = S(t - s)z + / S(t - o)8(o)V (k) (a,s)zdo 

s 

for z € Z and 0 _< s _< t _< T. 

It then follows from [8], [17] that 

(]r\ 

v '(t ,s)z — ► V(t ,s)z for z € Z and 0 s _< t T 

(k) 

where the convergence is uniform in t and s. If V (t,s) belongs to the 
class then for z£l?(A), B(t)V^^(t ,s)z is continuously differentiable 

in t and 

ft (B(t)V (k) (t,s)z) = B(t)V (k) (t,s)z + B(t) V (k) (t,s)z. 

It now follows from (4.2) and [13, p. 487] that for z£D(A), V^ k+1 \t,s)z is 
continuously differentiable in t and satisfies 


( k +l)(t jS )z + 8(t)V^ k ^(t ,s)z 


or 


ft V (k+1) (t,s)z = AV 
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~ V (k+1) (t,s)z = S(t - s)(A + B(t) )z + J Z S(t - o)B(o)V (k) (a,s)zda 


(4.3) 


+ / S(t - a)B(a) 1^- V (k) (a,s)zda, 
s 


for 0 < s < t < T« 


Hence by induction, '(t,x)z belongs to Q for k > 0. From (4.3) 


^ V (k+1) (t,s)z - -jL V (k) (t,s)z 


(4.4) 


= / S(t - a)B(a)(v (k) (a,s) - V (k_1) (o,s) )zda 


+ / S(t - a)B(a)(|- V (k) (a,s)z - V (k 1) (a,s)z)d« 


By induction on k one easily verifies the estimate: 


nv (k) (t,s) - V (k-1) (t,s)n < c x - k y s) 


C. = max VS(s)ll and M. = max II S ( t - s)B(s)l 
0<s<T 0<s<t<T 


Since B(t)z is continuous for each z CZ, B B( t ) II is uniformly bounded on 

[0,T]. Thus, from (4.4) 


"Tc v<k+1>(t - s)2 - If v (k) (t, s )z. < Cj Mj {H-T5T 121 


+ Mi / H-ij V^(a,s)z - v' ,K 1 ‘ , (a,s)zlld<j 


3 „(lc-l) J 
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where 


M_ = max BS(t - s)S(s)ll. 
0<s<t<T 


By induction on k one obtains 


“It v(k)(t,s)z " It v(k_1) (t.s)zn < [l ~ y] t m 2 m i _ 1 C 1 " zl 


+ (t , c. nAzii. 

k! 11 


Hence, V^^(t,s)z converges to a function of C(s,T;Z) for 0 < s < t < T 
<3 t — — — 

and z€ tXA) where the convergence is uniform in t and s# Note that the 
differential operator on C(s,T;Z) is closed. These facts, when 
combined with the convergence of V^^(t,s)z to V(t,s)z in C(s,T;Z), show 
that for z eV(A) V(t,s)z is continuously differentiable in t, and the 
derivative is jointly continuous in t and s. Since 


t 

V(t,s)z = S(t - s)z + / S(t - a)B(a)V(a,s)zda 

s 

for z € Z and 0 < s < t < T, 


it now follows from [13, p. 487] that for z€P(A)» V( t ,s)z € t?(A) and 


■§£ V(t,s)z - (A + 8(t))V(t,s)z 


for 0 < s < t < T. 


(Q.E.D) 
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Lemma 4.3: _If^ GZCt?(A*), then for zeV(A) and t < T, II(t)z e V(A*) 

and t — ► n(t)z is strongly continuous in the Hilbert space V(A*) equipped 
with the graph norm . 

Proof : As a result of Theorem 2.1 it is only necessary to show that 

Jc 

A II(t)z is continuous for z€P(A). Recall that for z€Z 

T 

(4.5) n(t)z = S*(T - t)GU(T,t)z + / S*(a - t)C* CU(a,t)zda. 

t 

From Theorem 4.1 and Lemma 4.2, for zeP(A) U(o, t)z is continuously 
differentiable in a. Thus it again follows from [13, p. 487] that 

II(t)zeP(A*), t<T 

and 


A* n(t)z = S*(T - t)( A* G + C* C )U(T,t)z 


* 

- C Cz 


- I 

t 


* 

S (a - 


t)C 


C U(a,t)zda. 


From Lemma 4.2, a — ► U(a,t)z is strongly continuous for 0 < t < a < T 

and z€ 17(A). Hence t — A II(t)z is strongly continuous for z€tKA). 

(Q.E.D) 


We are now ready to state the main result of this section. 
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Theorem 4.4: For zeV(A), II(t)z is a unique strong solution to the 

Riccati equation in the sense that II(t)z is continuously differentiable on 
[0,T], n(t)z € V(A*) for 0£t^T and the strong differential Riccati 
equation : 

(4.6) (iL. n(t) + A* n(t) + n(t)A - n(t)BB* n(t) + c* c)z = o 

for all z et)(A) 


n(t) = G 

is satisfied on [0,T]. 

Proof: We only need to prove that (4.6) holds for 0 <_ t T. From 

(2.6) , we have for all x,y € V(A) 

4 - <II(t)x,y> + <Ax,II(t)y> + <II(t)x, Ay> - <B* II(t)x,B* n(t)y> + < x, y> = 0. 
dt 

It then follows from Theorem 4.1 and Lemma 4.3 that 

(4.7) <(^-n(t) + A* n(t) + n(t)A - n(t)BB* n(t) + c* c)x,y> = o 

for all x,y,elXA). 

Since V(A) is dense in Z, (4.7) holds for all y€Z, which completes the 
proof . 


(Q.E.D) 
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Corollary 4.5: _If_ GZCD(A*) and the Initial data z€0(A), then the 

optimal control u® to (2,4) is continuously differentiable on [0,T] . 

Proof : From Theorem 4.1 and Lemma 4.2, z^(t) = U(t,0)z is continuously 

differentiable for z€P(A). Therefore, the continuous differentiability of 
u® follows from (2.5) and Theorem 4.1. 

Remark : From Lemma 4.2 and Theorem 4.1, if z eP(A), then z(t)eP(A), 

t ^ 0 and 

(4.8) u°(t) = - b [•jjr n(t)z(t) + n(t)z(t)) = ^(/f n(t) + c* C) z ( t ). 

5. Hereditary Differential System 

In this section we discuss the hereditary differential system: 


(5.1) 

ir x(t> 

0 

- J 

-r 

dy(9)x(t 

+ 9) + Bu( t) , 




X 

ft 

o 

= n 

and x( t 

*\ 

N 

CD 

w 

-©- 

II 

CD 

+ 

O 

-r < 9 < 0, 


where y(*) 

is an 

nxn 

matrix 

valued function 

of bounded 

variation which 

vanishes at 

0 = 0 

and 

is left 

continuous on 

• 

O 

u 

1 

vy 

Without loss of 

generality we can assume 

that for 

0 > 0, p(0) = 0 

and for 9 

< ~r, 


p(9) = y(-r). B is an nxm matrix. The observation y is given by 


(5.2) 


y(t) = Cx(t) 
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where C is a pxn matrix. We will denote by Z, the product space 

If 1 x I^C-r ,0; I?) in this section. Given an element zeZ, lie® 1 and 

<(> € L <2 denote the two coordinates of z : z = (ti,<|>) . It is well known [3], 

[9] that for (n»<j))€Z and u locally square integrable, (5.1) admits a 

unique solution x€L 2 (tg - r,T; if^OH^tg.T; if 1 ) for any T >_ t Q . If 

tg = 0, then (5.1) can be formulated as an evolution equation on Z. 

(5.3) ^ z(t) = Az(t) + Bu(t), t>0 

where z(t) = (x(t),x(t + «))CZ, t 0 and 8u = (Bu,0) £ Z for u € If 1 . 
The infinitesimal generator A is then defined by 

V(A) = {(n,<f>)ez| n = <(>(0) and ieL 2 } 

and for (<j>(0) ,<{>)€ V(A) 


0 

A( *«»,♦) = [/ dp(0)<f.(0),t), 

-r 

and generates the strong continuous semigroup S(t): 

S(t)(n,<j>) = (x(t),x(t + •)), t 0 where x is the solution of (5.1) with 
tg = 0 and u = 0. Within this framework, the observation equation (5.2) is 
written as 

(5.4) y(t) = Cz(t) , t > 0 

where C(n,<f>) = Cp £ iP for (h,<|>)€Z. Thus the system ( 5 . 1 )— ( 5.2) is 
formulated as the model system (2.1)-(2.2) in which Z = If 1 x L 2 > U = iP 

and Y = iP. 
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The following lemma gives two important properties of the hereditary 
differential system which shall be used extensively in the subsequent 
development. 

Lemma 5.1: 

(i) _If X denotes the Hilbert space 0(A) equipped with the graph norm, 
t 

then / S(t - s)8u(s)ds is an X-valued function continuous in t 

0 

for each u € L2(0;T; if 1 ) and continuous in u for each t€[0,T]. 

(ii) If Y is a pxn matrix-valued function of bounded variation on 

0 

[-r,0] and H denotes an operator defined by H(ri,<f>) = / dY(9)<f>(9) 

-r 

for € Z, then there exists a nondecreasing function 

M(*) : [ 0 ,°°] — HR?" such that for zeZ 

T 

/ |HS(t)z | 2 dt _< M(T) II z II 2 . 

0 

Remark : The proof of (i) makes explicit use of the hereditary structure 

and is straightforward (though tedious). In (5.5) the expression f/S(t)z 
only makes sense when zeP(A) # However, because of (ii), we will use the 
expression HS(t)z, 0£t^T to denote the function in L 2 (0,T;lf) which 
is obtained by a continuous extension of the operator: 

zeV(A) -+ H S(t)z € L 2 (0,T;. if). 

Let us consider the linear quadratic optimal control problem: for given 

(h,<|>)€Z choose the control u € L2 (tQ,T; I? 1 ) that minimizes the cost 


functional 
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T 

(5.6) J(u,[t 0 ,T]) = / ( | Cx(t) | 2 + |u(t)| 2 )dt + <G Q x(T),x(T)>^ 

t 0 

where Gq is a nonnegative, symmetric matrix on I? and x(») is the 
solution to (5.1). Note that (5.6) can be equivalently written as 

T 

J(u,[t 0 ,T]) = / ( |Cz(t) | 2 + |u(t)| 2 )dt + <Gz(T),z(T)> z 

fc 0 

where G is a nonnegative, self-adjoint operator on Z defined by G(ri,<|>) 

= (Gq n.o) e z for (n,(()) £Z and z(*) is given by 

t 

z ( t ) = S(t - t Q )(Ti , <J>) + / S(t - s)Bu(s)ds , t _> 

fc o 

Hence Theorem 2.1 applies to the minimization problem (5.6). 

It follows from [11], [21] that if (y,^)€P(A ) then 

t|>( 9) ~ (h(0) “ y(-r)) T y € H^(-r ,0) 

and 

*(- r) = (v((-r) + ) - y(-r)) T y. 

Obviously Gz ^ P(A*) in general. So, Theorem 3.1 does not apply for (5.6) 
unless Gq = 0. However, as a result of Lemma 5.1 one can extend the results 
in Sections 3 and 4 to this case. We will discuss such an extension later and 
for the present consider the case Gq = 0. 

If Gq = 0, then the solution H(t) to the Riccati equation (2.6) is 
given by 

(5.7) n(t)z = / S (o - t)C CU(o, t)zdo. 

t 
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Let Aj. be the infinitesimal generator on Z defined by = P(A) and 

for (freH 1 , 

0 T 

AjCKOM) = (/ dy^ewe),*) 

-r 


and let S T (t) denote the CQ-semigroup generated by Ap Define the 
structural operator F on Z by 

0 - 

F( n , <f> ) = (nj dy(0<f>(£ - 0)) for (ri,<j>)ez. 

-r 

Then, the following result has been proven by Manitius [16]. 

Theorem 5.2: 

(i) FS(t) = S*(t)F, F* S T (t) = S*(t)F\ t > 0. 

(ii) _If z € V( A) , then FzeP(A^) and A^ Fz = FAz. 

(iii) _Xf_ zeP(Aji), then F* zeP(A*) and A* F* z = F* Aj z. 

Since C* = F* C*, it follows from (5.7) and Theorem 5.2 that 

T 

n(t)z = F* / S T (o - t)C* CU(o,t)zdo. 

Note that C* y = (C T y,0)€Z for yelP. Thus from (i) of Lemma 5.1 and 

A 

(iii) of Theorem (5.2), II(t)z€P(A ) for z£Z. Moreover, since the 
evolution operator U(o,t) is jointly continuous for 0 < t < o < T, A n(t)z 
is strongly continuous in Z for z e Z, and hence n(t)A has a bounded 
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extension to all of Z. The next result now follows from Theorem 4.4 and 
Corollary 4.5. 

Theorem 5.3: _If_ Gq = 0, then for z € Z, II(t)z is a unique strong 

solution to the Riccati equation in the sense that H(t)z is continuously 
differentiable on [0,T), II(t)z €V(A) for 0 < t _< T, and the strong 
differential Riccati equation : 

(4r n(t) + A* n(t) + n(t)A - n(t)BB* n(t) + c* c) z = o 

for all z £ Z 


is satisfied on [0,T). Moreover, the optimal control u^(0 to (5.6) is 
continuously differentiable on (0,T] for (n,<f>)€Z. 

Proof : From (4.8), if z = (n,<j>) £ V( A) , then vP is continuously 

differentiable and 


u°(t) = B* (A* n(t) + c* C )z°(t) 
z°(t) = U(t,0)(n,<()). 

It has been proven that A n(t)z is strongly continuous in Z for ze Z. 
So, the theorem follows since P(A) is dense in Z and U(t,0) is 
continuous on Z for t > 0. 


(Q.E.D.) 
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Let us turn to the case Gq * 0. Consider the Xth approximate problem 
to (5.6) in which the cost functional is given by 

T 

(5.8) j\u,[t 0 ,T]) = / ( |C z(t) | 2 + | u( t ) | 2 )dt + <G X z(T),z(T)> z 

t Q 

* —1 

where G^ = GJ^ and = X(XI - A) for X£p(A). Note that 
G^ZCU(A ) and G^ -+ G in trace norm since G has a finite rank. If 
n x (t), t T denotes the solution of the Riccati equation associated with the 
problem (5.8), then it follows from Theorem 3.1 that 

t * 

n x (t)z = G x z + / (J x (T,s)Q x (J x (T,s)zds, z€Z 
where Q x is a self-adjoint operator on Z defined by 

Q x = A* G x + G x A - G x B8* G x + C* C- 

Such a representation for Q x exists since G x A can be extended to all Z 

via (3.1). If we denote the optimal control for the original problem (5.6) 

by u® and the optimal control for the Xth approximate problem (5.8) by 
u x> it follows from [11, pp. 114-115] that u x converges strongly to u® 

in L 2 (tg ,T; I? 1 ) , and the convergence is uniform in tg for 0 tg T. 

The following three results are essential to discuss the extension of 
Theorem 3.1 and Corollary 4.5 to the case when Gq * 0. 

Lemma 5.4: GA has a bounded extension to all elements z£Z of the 

form z = (4>(0) ,4>) with <|> € C(-r ,0; I?) and there exists a nondecreasing 


function M(*) : [ 0 ,«») — iSf" such that for z€Z 
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(5.9) 


^ 9 9 

/ |GAS(t)zp dt < M(T)llzll. 

0 


Proof: For z = (K0),t) €0(A) 


0 . 0 
|GAz| = |G(/ dy(0)*(0),*)| = |G q / dy(0)<f>( 9) | 

-r -r 



| dp | 


C(-r ,0; if 1 ) * 


Since H^C-r ,0; if 1 ) is dense in 
extension. Upon identifying GA with 


CC-rjOjlf 1 ), GA has the prescribed 
H of Lemma 5.1, (5.9) follows. 


(Q.E.D) 


Lemma 5.5: For x,y€Z 

<G^ AU^(T,t)x, U^(T,t)y> — <GAlf(T,t)x, U(T,t)y> L 2 (t Q ,T). 

Remark : To be precise, Lemma 5.4 only extends G^ A and GA to 

x = (<K0) ,<f>) such that <f> £ C(-r ,0; if 1 ) . However, as functions in L£(tQ,T), 
the inner products may be extended to all Z. 

Proof : First note that U^( T,t)z converges strongly to U(T,t)z for 

z€Z and the convergence is uniform in t, and that 

T 

U x (T,t)z = S(T - t)z + / S(T - s)8u x (s)ds 


-24- 


where u x (») is the optimal control for the Xth approximate (5.8) on the 
time interval [t,T] with given initial condition z€Z. Since J 

A 

converges strongly to I as X ~ 0 n X = P(A), it follows from (i) of 
Lemma 5.1 and the fact that — *■ u° in L 2 (t,T:lC n ) that for t < T 

T 

f x (t) = J x J S(T - s)Bu x (s)ds 


converges strongly to 


f°(t) = / S(T - s)8u 0 (s)ds 

in X, Since l!f^(t)H^ is uniformly bounded in X and t€ [t Q ,T], by the 
dominated convergence theorem, f^(t) converges strongly to f^(t) in 
L 2 (to>T;X)* Hence <GAf^(t),J^ U^(T,t)y> converges strongly to 
<GAf (t) ,(i(T,t)y> in L^CtQjT) for ye Z, The remainder of the proof is to 
show that for z,y£Z 

(5.10) <GAJ x S(T - t)z,J x U x (T,t)y> --»■ <gAs(T - t)z,U(T,t)y> in L 2 (t Q ,T). 

As in Lemma 5.4, it can be shown that 

T 

/ |gAj s(t - t)z| 2 dt < muzii 2 z e z, 

t A 

0 

since IIJ X H is bounded uniformly in X. The desired result follows from 
direct applications of the triangle inequality and the dominated convergence 


theorem. 
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Lemma 5.6: There exist a finite rank (p) operator H on Z and a 

nonsingular diagonal matrix A jjn I? such that 

2<GAz,z> + <(C* C - GBB* G)z,z> = <AHz,Hz> ^ for zeP(A) 

]R P 

and H can be continuously extended to all elements z € Z of the form 
z = (KO), <f>) with <f> € C(-r,0; I?) . 

Proof : Let X' denote the strong dual space of X. We identify Z 

with its dual, so that XCZCX', If j is the canonical injection from X 

into Z: j<f> = (<|>(0),<f))€Z, <f>€X, then j is an embedding from X into Z; 

i.e*, j is injective and j(X) is dense in Z; thus it follows from 

Proposition 4 in [1, p, 65] that j" from Z to V' and j^j from X to 

X' are embeddings : 

j j' 

X * z + X' 

and the bilinear form (x,y) on X' x X is the unique extension by 

X y X 

continuity of the scalar product (x,y) of Z restricted to Z x X. Here 

(') stands for dual operators. Let us define an operator Q £ L(X,X') by 

Q = A"G + j'GA - j'GBB* Gj + j'C* C j . 

If i is the norm-preserving canonical map from X' into X, then iQ is a 
self-adjoint operator on X. Indeed, 

<iQx,y> x = <Qx,y> x , x = <x,Qy> x x „ = <x,iQy> x . 


-26- 


Since G and C have finite rank, Q has a finite rank, and so iQ does 

also. Suppose rank (iQ) = p. Then there exist an operator H on X and a 
nonsingular diagonal matrix A on if such that 

iQz = H AHz for all z € X = V (A). 



and that from Lemma 5.4 the right-hand-side of this equality is continuous on 
<f> € C(-r ,0; if). 

(Q.E.D.) 


The next theorem gives the extension of Remark 3.2 and Theorem 3.1 to the 
case G q * 0. 

Theorem 5.7: _I£ II(t), t _< T is the solution of the Riccati equation 

(2.6) with G(n,<{>) = (Gq ti,0) for (n,<f>) € Z, then for z € Z 

T 

n(t)z = Gz + / (HU( T,s))* AH(XT,s)zds 
t 

where H and A are defined in Lemma 5.6. 
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Proof : Recall that for t T and z€ Z 

T 

n^(t)z = G x z + / U*(t,s)Q x U x (T,s)zds. 

Since n x (t), t£ T converges strongly to H(t), uniformly on bounded 
t-intervals, for t _< T and x,y £ Z 

<II(t)x,y> = lim <II x (t)x,y> 

X+co 

T 

= lim (<G X x,y> + / {<A* G x U x (T,s)x, U x <T,s)y> 

t 

+ <U X ( T,s)x,A* G x U x (T,s)y> + <(C* C - G x BB* G x ) 

U x (T,s)x,U x (T,s)y>}ds). 

Hence from Lemma 5.5 and the fact that U x (T,s)z converges strongly 
to U( T,s)z for z£Z and the convergence is uniform in s, the dominated 

convergence theorem allows us to show that for t T and x,y € Z 

T 

<II(t)x,y> = <Gx,y> + / {<GAU(T,s)x, U(T,s)y> + <U(T,x)x,GAU(T,s)y> 

t 

+ <(C* C - GB8* G)U(T,s)x,U(T,s)y>}ds. 

Since U(T,t)z£0(A) for z€t?(A), it follows from Lemma 5.6 that for 
x,y € V(A) 

T 

<II(t)x,y> = <Gx,y> + / <AHU(T, s)x, HU (T,s)y>ds . 

t 
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But since H can be continuously extended to all elements z of the form 
z = (cf><0),<f>) with <J> € C(-r,0; I?) , it follows from (ii) of Lemma 5.1 and the 
arguments in the proof of Lemma 5.5 that (5.11) holds for all x,y€Z. 

(Q.E.D) 

The following results are concerned with the differentiability of the 
optimal control u^(») of (5.8). 

Theorem 5.8: For zCZ the optimal control u^(») of (5.8) is 

differentiable a.e. on [tg,T] with u® e L 2 [tg,T; I?) . 

Proof : It follows from Corollary 4.5 and (4.8) that if z = (n, <(>)€ V (A) , 

then u^(») is continuously differentiable on [tg,T] and is given by 

u ^(t) = B (A n ^(t) + C C )U^( t,t Q )z. 

From (2.8) 

T 

* J ’ A * 

n x (t)z = S (T - t)G x U x (T,t)z + / S (a - t)C CU^(o,t)zda for z€Z. 

Note that ZCV(A ). Hence using the same arguments as those in the proof 
of Lemma 4.3, one can show that K^(t)z eV(A*) for z€Z and t < T, and 
moreover, A n x (t) is strongly continuous on [tg,T], Since U x (t,«) is 

strongly continuous on Z, this fact along with the closedness of the 
differential operator on C(tQ,T;lf 1 ), shows that for z €Z u x (t) is 

continuously differentiable on [tg,T]. We now note that for t <! T 
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B* A* S*(T - t)G x = B* A* S*(T - t)J* GJ X 

= B* A* S*(T - t)J* F* GJ X (using F* G = G) 

= B A S (T - t)F I x GJ X 

= B* F* A t s t (t - t)l x GJ X 

= B* Aj, S t (T - t)I x GJ X (using B* F* = B* ) 

where 1^ = X(XI - A^) ^ , X€ p(A) and we have used Theorem 5.2 
successively. Since B ( ti , cj>) = B ri, the arguments, as in the proof of Lemma 
5.4, yield that 8* A^ has a bounded extension to all elements z€Z of the 
form z = (4>(0) ,<{>) with <|)eC(-r,0;I?) and 

T 

(5.12) / |B* A S (T - t)z| 2 dt < M(T)llzl1 2 

0 

for M(*) : [O, 00 ) — 1R*" nondecreasing. Hence one obtains 

| r u x (t) = B* A*{s*(T - t)G x U x (T,t) 

x 

+ / S*(o - t)C* CU^Co, t)da} U x (t,t 0 )z + $ (f CU x (t,t Q )z 

= B* Aj, S X (T - t)I x GJ X U x (T,t Q )z 
T 

+ B* Ap / S T (a - t)(f CU^c.t^zda 
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+ B C CU^(t,tQ)z. 

Note that U^(t,t 0 )z converges strongly to U(t,t 0 )z for zCZ, and the 
convergence is uniform on [tQ,T] . Since 1^ and converge strongly to 

the identity operator on Z, 1^ GJ^ U^(T,tQ)z converges strongly to 
Gli(T,tQ)z for z € Z. It now follows from (i) of Lemma 5.1 and (5.12) that 

is a convergence sequence in L 2 (tQ ,T; IP) , which completes the 
proof when combined with the closedness of the differential operator 
on l^Ctg ,T; I? 1 ) . 

(Q.E.D.) 

This last corollary establishes the Chandrasekhar equations for 
hereditary differential systems. 

Corollary 5.9 Define the operator L(») Z _by L(t)z = HU( T,t)z, 

0 < t < T for all z £ Z, and the gain operator K(t) = B II(t), t<^T. 
Then K(t)z and L(t)x are differentiable on *[0,T] for z£Z and 
x£p(A), and they also satisfy 


^ K(t)z = -B* L*(t) AL(t)z , z e Z 

K(t) = 8* G 

and 

L(t)x = -L(t)(A - BK(t))x, xeP(A) 


L(T)x = H x 
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Proof : From (2*7), 

T 

L( t)8v = HS(T - t)Bv - H / S(T - s)BK(s)U(s ,t)Bvds for v € IP. 

t 

Here note that HS(x)Bv= H(x(t),x(t + •)), t>0 where x is the 

homogeneous solution of (5.1) with initial condition Bv and x € BV(-r ,T; if 1 ) 

j!xm 

for any T 0. This means that L(t)B € M exists for each t, and it is 
not difficult to show that L(t)B is of bounded variation on [0,T] • So 

B* L*( • ) = (L( • )B)* € It then follows from Theorem 5.7 that for z€Z 

T 

K(t)z = B* Gz + / B* L*(s) AL(s)zds; 
t 


and hence K(t)z Is differentiable on [0,T]. 

Note that for x€l?(A), (J(T,t)x is continuously differentiable with 
respect to t and 

T 

U(T,t)x - x = / U(T,s)(A -BK(s))xds. 
t 

Since HU( T,t)B = L(t)B is integrable, 

T 

L(t)x -Hx = HU ( T,t)x -Hx = / HU( T,s)CA -8K(s))xds 

t 

T 

= / L(s)(A -BK(s))x for x€t»(A). 
t 


(Q.E.D) 
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